Evaluating Parsers with Dependency Constraints

Many syntactic parsers now score over 90% on English in-domain evaluation, but the remaining errors have been challenging to address and difficult to quantify. Standard parsing metrics provide a consistent basis for comparison between parsers, but do not illuminate what errors remain to be addressed. This thesis develops a constraint-based evaluation for dependency and Combinatory Categorial Grammar (CCG) parsers to address this deficiency. We examine the constrained and cascading impact, representing the direct and indirect effects of errors on parsing accuracy. This identifies errors that are the underlying source of problems in parses, compared to those which are a consequence of those problems. Kummerfeld et al. (2012) propose a static post-parsing analysis to categorise groups of errors into abstract classes, but this cannot account for cascading changes resulting from repairing errors, or limitations which may prevent the parser from applying a repair. In contrast, our technique is based on enforcing the presence of certain dependencies during parsing, whilst allowing the parser to choose the remainder of the analysis according to its grammar and model. We draw constraints for this process from gold-standard annotated corpora, grouping them into abstract error classes such as NP attachment, PP attachment, and clause attachment. By applying constraints from each error class in turn, we can examine how parsers respond when forced to correctly analyse each class. We show how to apply dependency constraints in three parsers: the graph-based MSTParser (McDonald and Pereira, 2006) and the transition-based ZPar (Zhang and Clark, 2011b) dependency parsers, and the C&C CCG parser (Clark and Curran, 2007b). Each is widely-used and influential in the field, and each generates some form of predicate-argument dependencies. We compare the parsers, identifying common sources of error, and differences in the distribution of errors between constrained and cascaded impact. Our work allows us to contrast the implementations of each parser, and how they respond to constraint application. Using our analysis, we experiment with new features for dependency parsing, which encode the frequency of proposed arcs in large-scale corpora derived from scanned books. These features are inspired by and extend on the work of Bansal and Klein (2011). We target these features at the most notable errors, and show how they address some, but not all of the difficult attachments across newswire and web text. CCG parsing is particularly challenging, as different derivations do not always generate different dependencies. We develop dependency hashing to address semantically redundant parses in n-best CCG parsing, and demonstrate its necessity and effectiveness. Dependency hashing substantially improves the diversity of n-best CCG parses, and improves a CCG reranker when used for creating training and test data. We show the intricacies of applying constraints to C&C, and describe instances where applying constraints causes the parser to produce a worse analysis. These results illustrate how algorithms which are relatively straightforward for constituency and dependency parsers are non-trivial to implement in CCG. This work has explored dependencies as constraints in dependency and CCG parsing. We have shown how dependency hashing can efficiently eliminate semantically redundant CCG n-best parses, and presented a new evaluation framework based on enforcing the presence of dependencies in the output of the parser. By otherwise allowing the parser to proceed as it would have, we avoid the assumptions inherent in other work. We hope this work will provide insights into the remaining errors in parsing, and target efforts to address those errors, creating better syntactic analysis for downstream applications

Observation of the Isospin-Violating Decay Ds∗+→Ds+π0D_s^{*+}\to D_s^+\pi^0

Using data collected with the CLEO~II detector, we have observed the isospin-violating decay $D_s^{*+}\to D_s^+\pi^0$. The decay rate for this mode, relative to the dominant radiative decay, is found to be $\Gamma(D_s^{*+}\to D_s^+\pi^0)/\Gamma(D_s^{*+}\to D_s^+\gamma)= 0.062^{+0.020}_{-0.018}\pm0.022$.Comment: 8 page uuencoded postscript file, also available through http://w4.lns.cornell.edu/public/CLN

Semileptonic Branching Fraction of Charged and Neutral B Mesons

An examination of leptons in ${\Upsilon (4S)}$ events tagged by reconstructed $B$ decays yields semileptonic branching fractions of $b_-=(10.1 \pm 1.8\pm 1.4)\%$ for charged and $b_0=(10.9 \pm 0.7\pm 1.1)\%$ for neutral $B$ mesons. This is the first measurement for charged $B$. Assuming equality of the charged and neutral semileptonic widths, the ratio $b_-/b_0=0.93 \pm 0.18 \pm 0.12$ is equivalent to the ratio of lifetimes. A postscript version is available through World-Wide-Web in http://w4.lns.cornell.edu/public/CLNS/1994Comment: 9 pages (in REVTEX format) Preprint CLNS94-1286, CLEO 94-1

Production and Decay of D_1(2420)^0 and D_2^*(2460)^0

We have investigated $D^{+}\pi^{-}$ and $D^{*+}\pi^{-}$ final states and observed the two established $L=1$ charmed mesons, the $D_1(2420)^0$ with mass $2421^{+1+2}_{-2-2}$ MeV/c$^{2}$ and width $20^{+6+3}_{-5-3}$ MeV/c$^{2}$ and the $D_2^*(2460)^0$ with mass $2465 \pm 3 \pm 3$ MeV/c$^{2}$ and width $28^{+8+6}_{-7-6}$ MeV/c$^{2}$. Properties of these final states, including their decay angular distributions and spin-parity assignments, have been studied. We identify these two mesons as the $j_{light}=3/2$ doublet predicted by HQET. We also obtain constraints on {\footnotesize $\Gamma_S/(\Gamma_S + \Gamma_D)$} as a function of the cosine of the relative phase of the two amplitudes in the $D_1(2420)^0$ decay.Comment: 15 pages in REVTEX format. hardcopies with figures can be obtained by sending mail to: [email protected]

Measurement of the branching fraction for Υ(1S)→τ+τ−\Upsilon (1S) \to \tau^+ \tau^-

We have studied the leptonic decay of the $\Upsilon (1S)$ resonance into tau pairs using the CLEO II detector. A clean sample of tau pair events is identified via events containing two charged particles where exactly one of the particles is an identified electron. We find $B(\Upsilon(1S) \to \tau^+ \tau^-) = (2.61~\pm~0.12~{+0.09\atop{-0.13}})$. The result is consistent with expectations from lepton universality.Comment: 9 pages, RevTeX, two Postscript figures available upon request, CLNS 94/1297, CLEO 94-20 (submitted to Physics Letters B

Precision Measurement of the Ds∗+−Ds+D_s^{*+}- D_s^+ Mass Difference

We have measured the vector-pseudoscalar mass splitting $M(D_s^{*+})-M(D_s^+) = 144.22\pm 0.47\pm 0.37 MeV$, significantly more precise than the previous world average. We minimize the systematic errors by also measuring the vector-pseudoscalar mass difference $M(D^{*0})-M(D^0)$ using the radiative decay $D^{*0}\rightarrow D^0\gamma$, obtaining $[M(D_s^{*+})-M(D_s^+)]-[M(D^{*0})-M(D^0)] = 2.09\pm 0.47\pm 0.37 MeV$. This is then combined with our previous high-precision measurement of $M(D^{*0})-M(D^0)$, which used the decay $D^{*0}\rightarrow D^0\pi^0$. We also measure the mass difference $M(D_s^+)-M(D^+)=99.5\pm 0.6\pm 0.3$ MeV, using the $\phi\pi^+$ decay modes of the $D_s^+$ and $D^+$ mesons.Comment: 18 pages uuencoded compressed postscript (process with uudecode then gunzip). hardcopies with figures can be obtained by sending mail to: [email protected]

Measurement of the Decay Asymmetry Parameters in Λc+→Λπ+\Lambda_c^+ \to \Lambda\pi^+ and Λc+→Σ+π0\Lambda_c^+ \to \Sigma^+\pi^0

We have measured the weak decay asymmetry parameters (\aLC ) for two \LC\ decay modes. Our measurements are \aLC = -0.94^{+0.21+0.12}_{-0.06-0.06} for the decay mode $\Lambda_c^+ \to \Lambda\pi^+$ and \aLC = -0.45\pm 0.31 \pm 0.06 for the decay mode $\Lambda_c \to \Sigma^+\pi^0$. By combining these measurements with the previously measured decay rates, we have extracted the parity-violating and parity-conserving amplitudes. These amplitudes are used to test models of nonleptonic charmed baryon decay.Comment: 11 pages including the figures. Uses REVTEX and psfig macros. Figures as uuencoded postscript. Also available as http://w4.lns.cornell.edu/public/CLNS/1995/CLNS95-1319.p

Observation of the Ξc+\Xi_c^+ Charmed Baryon Decays to Σ+K−π+\Sigma^+ K^-\pi^+, Σ+Kˉ∗0\Sigma^+ \bar{K}^{*0}, and ΛK−π+π+\Lambda K^-\pi^+\pi^+

We have observed two new decay modes of the charmed baryon $\Xi_c^+$ into $\Sigma^+ K^-\pi^+$ and $\Sigma^+ \bar{K}^{*0}$ using data collected with the CLEO II detector. We also present the first measurement of the branching fraction for the previously observed decay mode $\Xi_c^+\to\Lambda K^-\pi^+\pi^+$. The branching fractions for these three modes relative to $\Xi_c^+\to\Xi^-\pi^+\pi^+$ are measured to be $1.18 \pm 0.26 \pm 0.17$, $0.92 \pm 0.27 \pm 0.14$, and $0.58 \pm 0.16 \pm 0.07$, respectively.Comment: 12 page uuencoded postscript file, postscript file also available through http://w4.lns.cornell.edu/public/CLN